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The decline of cognitive function in old age is a great challenge for modern society. 
The simultaneous increase in dementia and other neurodegenerative diseases justifies 
a growing need for accurate and valid cognitive assessment instruments. Although 
in-person testing is considered the most effective and preferred administration mode 
of assessment, it can pose not only a research difficulty in reaching large and diverse 
population samples, but it may also limit the assessment and follow-up of individuals with 
either physical or health limitations or reduced motivation. Therefore, telephone-based 
cognitive screening instruments can be an alternative and attractive strategy to in- 
person assessments. In order to give a current view of the state of the art of 
telephone-based tools for cognitive assessment in aging, this review highlights some 
of the existing instruments with particular focus on data validation, cognitive domains 
assessed, administration time and instrument limitations and advantages. From the review 
of the literature, performed using the databases EBSCO, Science Direct and PubMed, it 
was possible to verify that while telephone-based tools are useful in research and clinical 
practice, providing a promising approach, the methodologies still need refinement in the 
validation steps, including comparison with either single instruments or neurocognitive 
test batteries, to improve specificity and sensitivity to validly detect subtle changes in 
cognition that may precede cognitive impairment. 



Keywords: neurocognitive impairment, early detection, rapid-assessment tools, dementia, telephone-based 
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OVERVIEW 

In the past years, improvements and progress in the health sci- 
ences have contributed to people living longer lives. In order to 
optimize physical and mental health, as well as well-being, during 
aging, appropriate gerontological research addressing changes in 
cognition is needed. Of note, aging is usually associated with an 
overall gradual decline in cognitive functioning, particularly in 
information processing/ attention, memory and executive func- 
tion, which may lead to a decrease in independence of daily 
living and, thus, of life quality (Salthouse, 2010). However, decline 
in cognitive domains is not uniform across all individuals, and 
even in the same individual, throughout aging (Riddle, 2007). 
For instance, factors that can possibly confer a risk of decline 
in cognitive performance, other than age in itself, are low(er) 
level of schooling, institutionalization, female gender, depressive 
mood, and the presence of "unhealthy" lifestyle factors and/or 
of clinical pathologies (Ardila et al., 2000; Van Gool et al., 2003, 
2007; Wilson et al, 2009; Yamamoto et al, 2009; Paulo et al., 
2011; Kohler et al., 2012; Santos et al, 2012; Costa et al, 2013; 
Viscogliosi et al., 2013). This heterogeneity in cognitive aging, and 
the need to reach larger population samples, challenges the avail- 
able instruments that currently exist to efficiently assess global 



cognition and screen/detect deviations from healthy ("normal") 
cognitive aging to cognitive impairments and dementia. 

Cognitive impairment is defined as a clinical and transi- 
tional condition that spans from age-related memory impairment 
(AMI) to dementia (Petersen, 2004). Specifically, the American 
Academy of Neurology includes as criteria for mild cognitive 
impairment (MCI) the presence of memory complaints (prefer- 
ably corroborated by an informant) and memory impairment, 
albeit still presenting normal global cognitive functioning and 
intact activities of daily life (ADL) (Petersen et al, 2001). Because 
cognitive impairments diagnosed as MCI are not severe enough 
to have a significant impact on daily life, individuals with MCI 
may be easily missed. Therefore, these individuals, who present 
a cognitive impairment, but without functional deficits, are at 
higher risk for dementia. Any possible intervention strategies to 
prevent this transition or, more precisely, the assessment of inter- 
vention strategies, requires the availability of valid and reliable 
screening assessment tools. At present, the gold standard to assess 
cognitive functioning, and to diagnose MCI and dementia, in 
older adults, is in-person (face -to -face) evaluation using a bat- 
tery of standardized and validated cognitive tests (Herr and Ankri, 
2013). However, this procedure implies high effort and time for 



Frontiers in Aging Neuroscience 



www.frontiersin.org 



February 2014 | Volume 6 | Article 16 | 1 



Castanho et al. 



Telephone-based cognitive screening 



the administration of the comprehensive cognitive battery by spe- 
cialized researchers/clinicians. In addition, it holds also the risk of 
sampling biases because studies tend to comprise healthier and 
more educated older subjects, and those without limitations of 
mobility (Pachana et al., 2006). Therefore, cognitive assessment 
performed by telephone may provide an efficient, practical and 
valuable alternative and/or complementary strategy to the tradi- 
tional face-to-face test administration methodology (Kliegel et al., 
2007). 

In fact, since the introduction of the Telephone Interview 
for Cognitive Status (TICS), by Brandt et al. (1988), cogni- 
tive screening instruments administered by telephone have been 
shown to provide some key advantages. Foremost, they not only 
allow a "rapid-administration" protocol that can be utilized by 
health care professionals, and/or researchers, on a regular basis 
(albeit being designed in a manner that can also be applied 
in the course of "normal" face-to-face evaluations if needed). 
Complementarily, they also serve as a more cost-effective and 
rapid-screening cognitive tools in medium- to large-scale epi- 
demiological studies (Rabin et al., 2007), providing a means to 
lower dropout rates in longitudinal studies and overcoming geo- 
graphical limits (Beeri et al., 2003). Furthermore, their indirect 
application is more likely to be well accepted by older/ elder sub- 
jects who may present impediments in their physical mobility 
or health status, and/or with reduced motivation and, there- 
fore, allow both "cognitive triage" and follow-up assessments 
in population samples that are difficult to reach (Kliegel et al., 
2007). Finally, the practicability and efficiency of use is mainly 
derived from the instruments' design. The more accessible tele- 
phone instruments follow the model of the most widely accepted 
in-person brief screening measure for dementia diagnosis, the 
Mini-Mental State Examination (MMSE) (Wolfson et al, 2009). 

The goal of this review is to provide a compiled base of the 
available telephone-based instruments for neurocognitive screen- 
ing. Information is provided on the instrument purpose, authors, 
validation sample, and gold standard. Furthermore, characteris- 
tics regarding administration time, number of items, maximum 
score, cut-off threshold for cognitive impairment, and sensitivity 
and specificity measures are also provided. It is also reported if the 
instrument has been applied in other cohorts and/or translated 
to languages other than the original. Finally, an overall criti- 
cal analysis is provided, informing on strengths and weakness of 
the instruments. 

LITERATURE REVIEW 

The systematic search of the literature was conducted in the 
EBSCO, Science Direct, and PubMed databases, using a com- 
bination of the search terms "telephone assessment," "aging" 
(or "ageing"), "cognitive evaluation," "MCI," "dementia," "tele- 
phone interview (for) cognitive status," "validation question- 
naire" and/or names of the specific instruments as these were 
identified. The search was limited to articles published in 
English and to instruments that allow discriminating between 
"normal" cognitive aging and cognitive impairment/dementia. 
Instruments/batteries administered by telephone to assess for 
cognitive function, and/or impairment, in non-aging cohorts, 
and/or designed for specific clinical cohorts [such as, for 



example, used to assess cognitive function in patients with 
pulmonary arterial hypertension (Taichman et al., 2005) or 
with chronic fatigue syndrome (McCue et al, 2002)], were not 
considered. Exceptions were for MCI, dementia, Alzheimer's 
disease, stroke and/or other cognitive-related disorders. Titles 
and abstracts were evaluated as a first step and then full- 
text articles were read for their relevance to this review. 
Two separate researchers conducted the search and the lists 
were cross-compared to generate a compiled list. The litera- 
ture search was conducted between September 2012 and April 
2013, with a total final of 19 separate telephone-administered 
screening tools identified. The search procedure is summa- 
rized in Figure 1, following the "Preferred Reporting Items for 
Systematic Reviews and Meta- Analyses (PRISMA)" flow dia- 
gram template (Moher et al., 2009). Table 1 summarizes the 
instruments, including number of elements/items and time 
of administration, and reporting on measures of validity. 
Furthermore, for each instrument, overall characteristics, useful- 
ness and applicability, in clinical and research contexts, are next 
described. 

TELEPHONE-BASED NEUROCOGNITIVE SCREENING 
INSTRUMENTS 

TELEPHONE INTERVIEW FOR COGNITIVE STATUS (TICS) AND 
TELEPHONE INTERVIEW FOR COGNITIVE STATUS— MODIFIED (TICSM) 

The TICS instrument was originally purposed for the evalua- 
tion of cognitive functions in patients with Alzheimer's disease 
(Brandt et al., 1988; Brandt, 1991). Surpassing its original intent, 
it is now the most frequently used telephone-based cognitive 
screening test in medium-to large-scale studies and epidemiologic 
surveys (Herr and Ankri, 2013). Briefly, it assesses orientation 
to time and place, attention, short-term memory, sentence rep- 
etition, immediate recall, naming to verbal description, word 
opposites and praxis. The TICSM is the TICS modified ver- 
sion, adding a measure of delayed verbal recall. Both instruments 
have been translated into several languages, including Finnish, 
French, German, Hebrew, Italian, lapanese, and Spanish, serv- 
ing an important role in clinical and research contexts. In clinical 
trials, TICS discriminated carefully diagnosed Alzheimer's dis- 
ease patients from healthy controls, and in a sample of stroke 
patients TICS and TICSM were found valid instruments for eval- 
uating cognitive function (Brandt et al, 1988; Barber and Stott, 
2004). In epidemiological studies, both instruments detected a 
range of mild to moderate cognitive disorders and appeared to 
have comparable sensitivity and specificity as cognitive screen- 
ing instruments for dementia and Alzheimer's disease (Welsh 
et al, 1993; Smith et al., 2008; Wolfson et al, 2009). There 
is, however, relatively little information concerning its use in 
longitudinal studies (Lopez and Kuller, 2010) and with older 
individuals (Baker et al, 2013). Both the TICS and TICSM' 
scores are highly correlated (r = 0.94, p < 0.001 and r = 0.57, 
p < 0.05, respectively), with the MMSE (Brandt et al, 1988; 
Jager et al., 2003). Furthermore, TICSM scores are adjusted to 
subjects' educational level (Gatz et al, 2002) and it is assumed 
to distinguish reliably between normal cognition, MCI and 
dementia (Knopman et al., 2010). Despite its wide use, the 
only information reported on its application is indicated in the 
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Records identified through 
database searching 
(n = 429) 



Additional records identified 
through other sources 
(11 = 312) 



ft 



Records after duplicates removed 
(n = 229) 



ft 



Records screened 
(n = 229) 



Records excluded 
(n= 158) 



ft 



Full-text articles assessed for 
eligibility 
(n = 71) 



Full-text articles excluded 
(n= 19) 



ft 



Studies included in qualitative 
synthesis 
(n = 52) 



ft 



Studies included in quantitative synthesis 
(n = 32 , from which n = 19 correspond to 
the original validation articles) 



FIGURE 1 | Flow diagram of the literature review. Depiction of the flow of information through the different phases of the review. PRISMA flow diagram 
template (Moher et al., 2009). 



TICSM validation study, in which psychometricians applied the 
instrument. 

The original study indicates some key strengths of the instru- 
ment, including: cost-effectiveness for use in large-scale stud- 
ies; little evidence of ceiling and/or practice effects; and greater 
acceptability by participants, who appear to find the telephone 
interview less threatening than if conducted in a face-to-face clinic 
assessment. These indicate for the possibility of lower dropout 
rates in trials and longitudinal studies. Another strength relates 
with the fact that it addresses the lower end of the cognitive abil- 
ity spectrum (dementia) (Kliegel et al., 2007). Still, the authors 
also report on some important instrument limitations, namely: 
individuals with hearing impairment may be unable to complete 
the test or make errors; certain words are more difficult for par- 
ticipants to distinguish clearly and require careful attention to 
pronunciation; concentration and recall repetition may be hin- 
dered if words are not clearly heard. Finally, the authors also note 
that the instrument must be validated in preclinical populations, 
so to assess for the positive predictive value in healthy or mildly 
impaired or "ambiguous" cases. 



TELEPHONE VERSION OF THE MINI-MENTAL STATUS EXAMINATION 
(ALFI-MMSE) AND THE 26-P0INT ADAPTATION OF THE ALFI-MMSE 
(T-MMSE) 

This telephone-based version of the MMSE was originally admin- 
istered as part of the Adult Lifestyles and Function Interview 
(ALFI) (Roccaforte et al., 1992). It has been recommended 
as an instrument to examine cognitive function in patients 
with Alzheimer's disease, mainly regarding orientation, attention, 
memory recall, and calculation, and as means to reassess indi- 
viduals who have been evaluated in person, allowing to assess 
cognitive stability or estimating decline. The ALFI correlated sig- 
nificantly with other face-to-face screening tests, specifically the 
MMSE (r = 0.85; p < 0.001) and the Brief Neuropsychiatric Test 
(correlation andp-values not reported) (Roccaforte et al, 1992). 
The ALFI-MMSE has been used in several studies including 
stroke patients (Longstreth et al., 2010), post-myocardial infarc- 
tion patients (Thomas et al., 201 1), and older adults with different 
levels of nutritional risk (Roberts et al, 2007), as a practical 
assessment tool when face-to-face assessments were difficult to 
obtain. Subsequently, a 26-point adaptation of the ALFI-MMSE 
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was constructed (the T-MMSE), which in addition comprised a 
three-step action-based response ("say hello, tap the mouthpiece 
of the phone three times, then say I'm back") and the request to 
provide the phone number (Newkirk et al, 2004). The T-MMSE 
was validated in a group of patients with probable Alzheimer's 
disease (Newkirk et al., 2004), although the authors mentioned 
that future research using a randomized test order would be nec- 
essary to better estimate the effect of previous exposure to the test 
(test-retest). For both tests, the ALFI-MMSE and the T-MMSE, a 
clinical nurse specialist conducted the phone interviews. 

TELEPHONE ASSESSED MENTAL STATE (TAMS) 

Designed by Lanska et al. (1993) and adapted from the MMSE, 
this brief instrument is a compilation of 4-items that assess for 
orientation to time and place, attention and memory. In the pop- 
ulation sample of Alzheimer's disease patients, the TAMS' scores 
correlated well with those of instruments administered face-to- 
face; specifically, the TAMS was found to correlate significantly 
with the MMSE (r = 0.81, p < 0.001). Instrument scores were 
not independent of education. The authors report the instru- 
ment as inadequate for dementia diagnosis, or to assess subtle 
deficits, except in the context of a comprehensive clinical evalu- 
ation. The instrument is recommended to be administered by a 
trained psychometrician. 

SHORT PORTABLE MENTAL STATUS QUESTIONNAIRE (SPMSQ) 

The SPMSQ is a 10-item test that measures the presence and 
severity of cognitive impairment regarding orientation to time 
and place, memory for personal information and serial subtrac- 
tion (Roccaforte et al, 1994). It is a brief and easy instrument 
to administer that allows discriminating between subjects with 
dementia or without dementia. The SPMSQ telephone version 
was found to significantly correlate (r = 0.81, p < 0.001) with 
face-to-face MMSE (Smith et al., 2008). Regarding test applica- 
tion, no information was provided concerning specific qualifica- 
tions and/or skills required. 

BLESSED TELEPHONE INFORMATION-MEMORY-CONCENTRATION 
TEST (TIMC) 

The telephone version of the Blessed IMC consists of a 27-item 
list to evaluate verbal memory and orientation to time and place, 
which highly correlated with its face-to-face version (Spearman 
rank = 0.96, p < 0.001) (Kawas et al, 1995). The telephone- 
version has a greater acceptance by participants, compared with 
its face-to-face form, since the time needed for assessment is 
shorter. Despite being a potential instrument for epidemiologi- 
cal and longitudinal cognitive research, the authors recommend 
its administration in a broader and more varied population sam- 
ple for further validation. No information is provided regarding 
specific qualifications recommended for test applicants and/or 
interviewers. 

TELEPHONE SCREENING PROTOCOL (TELE) 

The TELE was introduced by Gatz et al. (1995) and it is based on 
the 10-item Mental Status Questionnaire (Kahn et al, 1960), with 
an additional 11 items concerning attention, verbal short-term 
memory and cognitive abstraction, and health issues. Clinical 
psychologists, registered nurses or other professionals with medi- 
cal background carried out the screening in the validation process 



(Gatz et al., 2002). On sensitivity and specificity measures it 
discriminated reliably between Alzheimer's disease patients and 
healthy cognitively normal individuals (Gatz et al., 2002), partic- 
ularly in the verbal working memory (digits backwards), 3-word 
recall, and indication of current month (Jarvenpaa et al., 2002). 
Initially designed to address the lower end of the cognitive ability 
spectrum, which is considered an advantage, it is consequently 
not as suitable in studies addressing normal cognitive aging 
(Kliegel et al, 2007), perhaps due to ceiling effects. 

TELEPHONE COGNITIVE ASSESSMENT BATTERY (TCAB) 

The TCAB was designed to evaluate elderly cognitive sta- 
tus, which can discriminate between mild cognitively impaired 
and cognitively normal individuals (Debanne et al., 1997). It 
comprises six categories concerning mental status, semantic 
memory, reasoning, executive ability and language. This instru- 
ment requires administration by a well-trained professional, 
preferably from the field of neuropsychology. It is noted by the 
original authors that further work is needed to indicate for its 
applicability in wider community settings. 

STRUCTURED TELEPHONE INTERVIEW FOR DEMENTIA ASSESSMENT 
(STIDA) 

Developed for the NIMH Genetic Initiative Alzheimer's Disease 
Study Group, and administered by skilled clinicians, the STIDA 
is a brief telephone screening instrument designed to discrim- 
inate people with normal cognitive functioning from those 
with cognitive changes due to early Alzheimer's disease (Go 
et al, 1997). It comprises items from the MMSE and from the 
Blessed-Orientation-Memory-Concentration (BOMC), and con- 
sists of six subscales including memory, orientation to time and 
place, judgment, and community and home activities. A much- 
abbreviated version of STIDA has been developed that contains 
questions on cognitive abilities and functional status (Go et al., 
1997); however, no published studies regarding its application 
were found. 

MEMORY IMPAIRMENT SCREEN TELEPHONE (MIS T) 

Based on the well-known in-person Memory Impairment Screen 
(MIS), this test contains the same semantic memory elements as 
the Free and Cued Selective Reminding (FCSRT) and the Double 
Memory Tests (DMT) (Lipton et al, 2003). The MIS-T was origi- 
nally designed to measure episodic memory (Buschke et al, 1999) 
in a validation sample of randomly selected older individuals, 
and has been applied in cross-sectional studies. In the validation 
study individuals were evaluated by a neurologist, a neuropsy- 
chologist and a social worker student (Lipton et al., 2003). Used 
independently and in conjunction with the Category Fluency Test 
(semantic memory), and with other telephone cognitive screen- 
ing tests, namely the TICS, the MIS-T demonstrated to be more 
robust than the TICS in discriminating dementia from normal 
cognitive functioning (Smith et al., 2008). 

MINNESOTA COGNITIVE ACUITY SCREEN (MCAS) 

The MCAS comprises nine cognitive domains, including orien- 
tation to time and place, attention, delayed word recall, compre- 
hension, sentences repetition, naming, computation, judgment, 
and verbal fluency (Knopman et al., 2000). The analysis of 
each domain score can be used to discriminate individuals with 
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cognitive impairment due to MCI or Alzheimer's disease from 
cognitively normal subjects. The MCAS has also been proven an 
effective screening instrument for memory disorders (Tremont 
et al, 2011). Regarding the test administration, no information 
is provided regarding applicants' qualifications. 

HOPKINS VERBAL LEARNING TEST (HVLT) 

The HVLT questionnaire assesses various aspects of verbal mem- 
ory: short and long delay recall and recognition (Brandt, 1991). 
Six distinct forms of HVLT are available, each containing a 12- 
item unique word list, which can be used to avoid practice 
effects due to repeated administration. Although it was designed 
for face-to-face application, the HVLT can also be adminis- 
tered by telephone (Brandt, 1991). The reliability and validity 
of the instrument has been verified in patients with traumatic 
brain injuries, schizophrenia and in most common subtypes of 
dementia (Alzheimer's disease and vascular dementia) (Kuslansky 
et al., 2004). No information is provided concerning specific skills 
recommended for test applicants. 

The HVLT has as main advantages its appropriateness for 
serial testing as part of longitudinal studies, with the possi- 
bility for alternative forms to be used to circumvent prac- 
tice effects (test-retest). Also, the results were independent of 
the effects of demographic variables, and as such it may be 
more appropriate for identifying memory deficits associated 
with dementing processes than the MMSE. As shortcomings 
of the instrument, the authors refer to its validation in sam- 
ples of convenience (patients referred to geriatric psychiatry 
and for neuropsychological evaluation); therefore, the authors 
indicate for the necessity of further research in other com- 
munity settings. It is also noted that the HVLT performance 
is compromised in persons with low reading ability (perhaps, 
as a proxy of education), as well as in individuals diagnosed 
with clinical depression. Further research is also recommended 
in order to develop shorter, efficient versions, or in com- 
bination with other tools to improve the sensitivity of the 
instrument. 

TELEPHONE ADAPTATION OF THE MODIFIED MINI-MENTAL STATE 
EXAM (T3MS) 

The T3MS is a modified version of the 3MS for the assessment 
of orientation to time and place, verbal memory, mental flexibil- 
ity, abstract reasoning and language. The outcome of the T3MS 
correlates with the 3MS (r = 0.82; p-value not reported). The 
T3MS can distinguish between patients with MCI and individ- 
uals without cognitive impairment, with a sensitivity of 82% 
and a specificity of 100%, and was found a reasonable substi- 
tute for its face-to-face version (Alexopoulos et al., 2006). This 
instrument was used in the Cache County Study, designed to 
examine factors associated with the risk of Alzheimer's disease 
and other forms of dementia (Norton et al., 1999). No informa- 
tion is provided regarding qualifications of the interviewers, and 
no comments are made regarding how it compares with other 
instruments. The authors recognized that more studies are nec- 
essary to extrapolate the results to individuals with moderate 
to severe cognitive impairment, as well as studies with a more 
homogeneous population. 



BRIEF SCREEN FOR COGNITIVE IMPAIRMENT (BSCI) 

The BSCI consists of a three-item test (delayed verbal recall, fre- 
quency of help with planning everyday activities, and frequency of 
help remembering to take medications), which is also suitable to 
detect dementia (Hill et al., 2005). The target sample of the orig- 
inal study comprised demented patients and cognitively healthy 
individuals. Compared with other screening tests, the BSCI has 
the advantage of being very brief and presenting no difficulties in 
its administration and scoring. However, the authors recommend 
that an experienced interviewer should conduct the evaluation. 
In addition, it should not to be used in a stand-alone evaluation 
of MCI or dementia (Fillit et al., 2003). The main advantage of 
the instrument is that it was designed to be included in initia- 
tives targeted to the elderly population, including comprehensive 
disease management and geriatric case management programs. 
Specifically, as described by the original authors, the BSCI can 
be incorporated into larger telephonic health risk assessments (in 
the original study those conducted by Medicare-managed care 
plans). No information is available regarding its application in 
other studies and/or cohorts. 

BRIEF TEST OF ADULT COGNITION BY TELEPHONE (BTACT) 

The BTACT is a brief test that covers several domains of adult cog- 
nition (Tun and Lanchman, 2006). Specifically, it assesses speed 
of processing, verbal working and long-term memory, executive 
function, and reasoning. Notably, the instrument can be paired 
with an optional computerized task-switching test, yielding fur- 
ther information on reaction time and executive function. The 
items are based on laboratory research and telephone versions 
of well-known psychometric testing instruments (these were not, 
however, specified). Furthermore, it was used as a part of the 
MIDUS-II (Mid-Life in the United States) study, which consisted 
of a sample of 7000 healthy individuals between 35 and 85 years of 
age (Tun and Lanchman, 2005). One important feature of this test 
is its applicability in well-functioning younger and middle-aged 
individuals as well as older people, from a range of educational 
backgrounds, and also in face-to-face evaluations, providing ver- 
satility in aging studies that span different age intervals (Tun 
and Lanchman, 2006). The authors recommend recording of the 
telephone interview and that, as hearing loss can compromise per- 
formance, a brief screening on hearing should be conducted at the 
beginning of the interview. No information is provided concern- 
ing specific characteristics and/or qualifications of the applicants 
and/or interviewers. 

MEMORY AND AGING TELEPHONE SCREEN (MATS) 

Developed and designed purposely by Rabin et al. (2007) for 
longitudinal assessment, the MATS consists of a subjective cog- 
nitive complaints questionnaire on subjects' perceived cognitive 
decline (onset, course, severity and impact on functioning), and 
10 cognitive items assessing verbal memory (list-learning). The 
instrument was not modeled after the MMSE and excluded items 
known to lack sensitivity in preclinical groups (e.g., orientation to 
person or place, basic expressive language, praxis), being designed 
to screen individuals with MCI and/or significant cognitive com- 
plaints. It provides a key advantage over other instruments by 
including both objective and subjective memory assessments, and 
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also by not showing a ceiling effect (even in cognitively intact 
controls). It is also reported that education, gender, and depres- 
sive symptoms did not significantly influence the results. Still, it is 
noted by the authors the relatively high education level of the par- 
ticipants in the validation sample, and that the instrument may 
be less sensitive to early cognitive impairment presented primar- 
ily in the form of nonamnestic deficits. Sensitivity and specificity 
were not determined, which limits the interpretation and utility 
of the test. It is indicated that longitudinal follow-ups are nec- 
essary to confirm the instrument's diagnostic value, to monitor 
rates of cognitive progression, and to identify which test variables 
best predict clinical conversion. The MATS can be also adminis- 
tered face-to-face by trained researchers/clinicians and it can be 
applied to individuals who cannot read and/or write and/or are 
visually impaired. 

COGNITIVE TELEPHONE SCREENING INSTRUMENT (COGTEL) 

The COGTEL is a six components screening instrument that cov- 
ers working, long-term verbal and prospective memory, verbal 
fluency and inductive reasoning (Kliegel et al., 2007). Its pur- 
pose is to assess cognitive-function domains across adulthood. 
The scores of the subtests can be analyzed one by one or be com- 
bined to a total score. Studies suggest that the COGTEL can be 
administered in large samples, including in cross-sectional, lon- 
gitudinal and/or epidemiological (Kliegel et al., 2007), allowing 
for the global assessment of cognitive function among healthy 
younger and older adults test without being constrained by ceil- 
ing effects. The ongoing epidemiological study "Estrogen and 
Thromboembolism Risk (ESTHER)" represents an example of 
where it has been applied (Breitling et al., 2010). No information 
is provided concerning specific characteristics and/or qualifica- 
tions of the applicants and/or interviewers. 

TELEPHONE MONTREAL COGNITIVE ASSESSMENT (T-MoCA) 

In order to reduce missing data for patients that cannot be physi- 
cally present in a clinical context, Pendlebury et al. (2013) devel- 
oped a telephone version of the Montreal Cognitive Assessment 
(MoCA), a widely recognized brief screening test for milder 
forms of cognitive impairment (Nashreddine et al., 2005). The 
T-MoCA includes items that do not require the use of a pen- 
cil and paper or a visual stimulus, with the exception of the 
sustained attention task where subjects have to tap the side of 
the telephone with a pencil, instead of tapping on the desk. 
This tool, combined with the TICSM, was tested in a sample of 
community-dwelling patients 1 year after they had a transient 
ischemic attack (TIA) or a mild stroke. Overall, although abstrac- 
tion, verbal fluency and repetition items may have been affected 
by telephone administration (patients performed worse), the T- 
MoCA proved to have sufficiently good accuracy to detect MCI 
among stroke/TIA patients (Pendlebury et al, 2013). The authors 
have also developed a shortened version of the T-MoCA (T- 
MoCA-Short) that includes only verbal fluency, verbal recall and 
orientation domains (Pendlebury et al, 2013). No information 
was provided regarding administration time or the T-MoCA(- 
Short) application in "healthy/normal" cognitive aging studies. 
Optimal cut-offs for the T-MoCA (and of the TICSM) will vary 
with different definitions of MCI. 



CONCLUDING REMARKS 

Screening for cognitive impairment is a relevant issue in clin- 
ical neuroscience and geriatrics. The use of cognitive assess- 
ments provides an important basis for diagnosing cognitive 
disorders and monitoring cognitive decline and, hence, disease 
progression. Specifically, the evaluation of cognition in healthy 
older/elderly individuals can help define the extent of alter- 
ations in cognition associated with normal aging, thus allowing 
a valid differentiation of "normal" (healthy cognitive aging) from 
"abnormal" (pathology-related cognitive decline/impairment) 
cognitive changes (Rapp et al, 2012). Here, culling from the 
available literature, we provide a compiled base of the avail- 
able telephone-based instruments for neurocognitive screening, 
giving information on the instrument, its main characteristics, 
and validation measures (Table 1). Based only on published and 
peer-reviewed studies, a total of 19 validated instruments were 
identified, with 26.5% of which further validated in countries 
(and/or languages) other than the original. A summary of the 
instruments is shown in Figure 2, reporting on main advantages 
and limitations. 

From the literature review, the TICS was identified as the 
most widely translated and validated instrument, which may be 
considered as a possible indicator of the extent of its applicabil- 
ity. Regarding the validation sample, most studies (31.6%) used 
a "mixed cohort" design; that is, instruments were applied in 
cohorts composed of both "healthy" individuals and those diag- 
nosed with MCI, dementia, minor stroke, TIA, Alzheimer's dis- 
ease (and/or Alzheimer's dementia, DAT) or dementia. These are 
altogether, hereafter, referred as "cognitively impaired." A similar 
percentage of studies (31.5%) conducted either a random (21%, 
community-dwellers) and/or convenience (10.5%, geriatric out- 
patient programs) sampling, for which, in both cases, no previous 
cognitive performance diagnosis was known regarding if partic- 
ipants were "healthy" or "cognitively impaired". The remaining 
studies focused either only on "healthy" (15.8%) or only on 
"cognitively impaired" (26.3%) individuals, with already previ- 
ous indication for the cognitive status. From the total of n = 2315 
patients/participants assessed, in the total of the 19 studies 
considered, a ratio of 2.62:3.04:4.34 was noted, respectively, 
"healthy":"cognitively impaired": "cognitively unknown" individ- 
uals. Largely, the instruments were applied in aging cohorts, with 
only the BTACT and the COGTEL having also been administered 
to younger cohorts. 

Perhaps as one of the overall major shortcomings, several 
instruments lacked direct comparison with more extensive cogni- 
tive batteries and/or validation in other cohorts. In fact, regarding 
the former, only 15.8% of the studies used a combination of 
gold standards strategies for validation, with only one-fifth having 
conducted clinical assessment (or use of the CDR or the DSM- 
III-R) criteria to confirm assessment ("healthy" vs. "cognitive 
impairment"), and one-third using validated scales/instruments 
(other than the MMSE/3M) for the same purpose. It is particu- 
larly disturbing that 10% of the studies did not use (or reported) 
any type of gold standard for comparison or measure of validity, 
and a similar percentage did not describe the validation strategy 
utilized. The MMSE (or the 3M) was used as the gold standard 
in the majority of the studies (36.8%). This may warrant some 
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Screening Target 


Instruments 


Strong Points 


Limitations 



Normal cognitive aging 



AMI 



MCI 



Dementia 



BTACT 

COGTEL 

HVLT 

MATS 

STIDA 

TCAB 

T3MS 



MCAS 

STIDA 

TCAB 

T-MOCA 

T3MS 



ALFI-MMSE 

BSCI 

HVLT 

MCAS 

MIS-T 

SPMSQ 

STIDA 

TAMS 

TELE 

TICS 

TICSM 

TIMC 

T-MMSE 



Of interest for medium/large- 
scale epidemiological studies, 
longitudinal designs or clinical 
follow-ups. 



Low expense, less time- 
consuming; 

Access a wider, more diverse 
range of individuals, from 
varied geographical zones, 
health and socioeconomic status, 
age, racial/ethnic background, 
and educational level; 
Comfort of the respondent, 
because do not have to face an 
interviewer if performing 
poorly; 

Administration times averages 

10-minutes; 

Data obtained over the 

telephone seem to be as valid 

and reliable as information 

obtained face to face (validity 

measures). 



Good sensitivity and specificity 
in the screening for Alzheimer 's 
disease and/or dementia. 



Hearing problems can be 
exacerbated; 

Background noise may interfere 
with the respondent clearly 
understanding the interviewer or 
failing to concentrate; 
The respondent may write words 
during a memory test or list 
down notes (cheating); 
Lack of possibility to control 
external aids (e.g. calendars or 
aid from other individuals); 
Some cognitive domains are not 
evaluated (e.g., visual, spatial or 
sensorimotor); 
Potential effects of age, 
education and ethnicity/cultural 
background on test 
performance; 

Psychological confounders (e.g., 
depression); 

If used cross-sectional cannot 
alone assess cognitive trajectory. 



Indicate provisional diagnosis, 
but warrant further 
climcal/neuroimaging 
evaluation. 



FIGURE 2 | Summary of the instruments for different screening goals. Key advantages and limitations of each set of instruments are identified. The 
choice of an appropriate screening measure depends on the question being asked and the sample studied. 



considerations. Despite the fact that the MMSE is the most com- 
monly used instrument for global cognitive screening (Molloy 
and Standish, 1997), possessing good reliability indexes, some of 
its limitations have been identified particularly in detecting sub- 
tle memory losses (Small, 2002). For instance, a subject with a 
low educational level may score poorly in the absence of cogni- 
tive impairment, while a subject with a higher educational level 
may score above threshold despite having cognitive impairment 
and/or respective decline in cognition (Brayne and Calloway, 
1990; Tombaugh and Mclntyre, 1992). As such, telephone-based 
cognitive screening tools have been mainly used to obtain a 
global cognition score and/or to address the lower end of the 
cognitive ability spectrum, but are unable to detect or indicate 
MCI onset and/or early phases of dementia, or indicate func- 
tional and psychological status. This is probably due to the fact 
that most instruments were at first developed to either detect 
dementia in normal samples (Crooks et al., 2005), and/or to facil- 
itate Alzheimer's disease studies, rather than to identify at-risk 
individuals in diverse contexts (Crooks et al., 2005). 

Feasibly, for validation purposes, and/or to guarantee the 
efficiency of the instrument in each subsequent study, a 
strategy to overcome the above mentioned shortcomings 
could be to conduct a "triage" screening assessment using a 



telephone-based tool and, in a parallel manner, accompany 
this with an in-person standard assessment using a compre- 
hensive neurocognitive test battery. This battery should com- 
prise domains from global cognition to information process- 
ing/attention, memory and executive function. This could be 
conducted in at least a percentage of the cohort, so to provide 
continued measures of internal validity. Some authors further 
suggest that telephone cognitive assessments could be preceded 
by an initial selection of subjects of interest made by postal ques- 
tionnaires, providing further "triage" points depending on the 
research question of interest (Van Uffelen et al., 2007). 

Interestingly, only for the MATS a longitudinal assessment 
was conducted in the validation study. This handicap should 
be addressed. The applicability of telephone assessment instru- 
ments should, after an initial assessment in a cross-sectional 
design, also be considered in a longitudinal approach if to 
better evaluate the sensitivity of the instrument for cognitive 
changes over time. A useful indication of the degree of cogni- 
tive decline can be gained by a combination of different methods 
in order to discriminate validly and reliably between healthy and 
"abnormal" mental aging across time (Mackinnon and Mulligan, 
1998). For example, a combined approach of a telephone-based 
cognitive-screening instrument with a questionnaire based on 
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informant reports [such as the Informant Questionnaire on 
Cognitive Decline in the Elderly, IQCODE (Jorm, 1994)] could 
be applied. Given their complementary characteristics, the com- 
bined use of telephone cognitive screening and informant reports, 
in cognitive evaluations, is expected to yield promising results in 
indicating for cognitive trajectories (Knafelc et al, 2003). 

All studies considered reported on the statistical methodology 
used in the data analysis, with 68.4% reporting on both sensitivity 
and specificity measures. On average, the size of the cohorts was 
n = 121 individuals. Given that, on average, the number of items 
per instrument was 15, and considering that sample size should 
be 10 times the number of items for analysis (Nunnaly, 1978; 
Comery and Lee, 1992; Tabachnik and Fidell, 1992), overall the 
studies considered lacked by 15% in sample size for proper val- 
idation. When considered separately, approximately 50% of the 
studies had sample sizes that were too small for validation, with 
these on average needing to double participant number for full 
validation. Nonetheless, it should also be noted that while "10 
subjects per item" is recommended when examining individual 
items, it is less clear if this applies when using the global score. 
Still, as some of the samples were small, making meaningful con- 
clusions regarding some of the tests is difficult. A total of nine 
studies included cut-off scores indicative of "cognitive impair- 
ment." This may overall be one of the most practical goals for 
the use of these instruments, placing them on similar ground 
with the rapid assessment tools already extensively used face- 
to-face. The average time of administration for the instruments 
considered was 10.8 min, with no administration time reported 
in six of the studies. Finally, common limitations were reported. 
The administration procedure could be particularly difficult for 
severely demented individuals, for those who had poor telephone 
communication skills or were hearing impaired and/or who were 
more easily distracted (shorter attention spans). Also, as tasks are 
instructed and solved verbally, those that involve visual, spatial, 
or sensorimotor skills cannot be evaluated. Finally, individuals 
may ask for the help of those nearby (or use external cues/aids) 
while performing the assessment (Smith et al., 2008). It is also 
overall recommended that future studies should evaluate for the 
test-retest and parallel-test reliabilities of the instruments. 

As discussed, the current shift in population demographics has 
been accompanied by a need to develop brief and accurate cogni- 
tive screening instruments, with the potential to be applied in dif- 
ferent research and clinical contexts for the cognitive assessment 
in medium to large-population samples (Petersen et al, 2001; 
lager et al., 2003). As face-to-face administration tools require 
individuals to be physically present, telephone instruments have 
been developed as an alternative. If developed, used and validated 
properly, despite intrinsic limitations, telephone-based cogni- 
tive assessment can considerably contribute to increase sample 
sizes by reaching more individuals, and can also provide a mean 
for minimizing costs and participants' burden and accessibility. 
Furthermore, several studies demonstrated that the outcome in 
cognitive assessments administered by telephone is similar to that 
conducted in face-to-face settings (Wilson and Bennett, 2005). 
Furthermore, it is also noted that telephone-based tools can 
reduce selection bias in epidemiology studies by allowing cover- 
ing large areas and facilitating follow-up (Herr and Ankri, 2013). 



A final comment concerns the use of telephone cognitive assess- 
ment for clinical diagnosis. Telephone-based cognitive instru- 
ments can be used as screening tools, but are inadequate tools 
for a diagnostic decision about the presence of MCI or dementia. 
Results warrant the same care in interpretation as if using face- 
to-face assessment with "rapid assessment" instruments (e.g., 
the MMSE). Telephone tools can be used for provisional early 
diagnosis, with later evaluation by accurate clinical examination, 
neuropsychological assessment, sources of information based on 
informant reports, and laboratory and imaging methods. In 
conclusion, telephone-based instruments should continue to be 
further developed and evaluated, and/or improved-on (namely 
in an era where distant video connection is emerging), in order 
to be utilized by health care professionals and researchers, serving 
as a viable complementary and/or alternative tool for cognitive 
screening in clinical and epidemiological settings. 
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